Test on mARPC (Submit&Ad) Uplift Summary // 2023-09-28 09:02:24

Test on mARPC (Submit&Ad) Uplift
For key_metric mARPC (Submit&Ad):

control value  = 0.86699
expeted value  = 0.95369
uplift         = 10.00%

for 50/50 traffic allocation we need to collect
sample_size_control: 29,432
sample_size_test:    29,432
--------------------------------------------------------------------
TOTAL SIZE: 58,864  || Approx. 35 days for daily 1,700 users
--------------------------------------------------------------------
T-Test, two-sided test
alpha = 5.00%
power = 80.00%